Loop to move the rotating turntable to different 1 
positions based on the t stepping angle 



?2 



Output positioning signal(s) 
to the rotating turntable 




Output signals to the camera 
to collect an image 



S4 



Sc. 



store the image data 



St 



Store information to link the angle of 
rotation of the rotating turntable 
with the captured image. 




Loop 



6Z. 



Fig. 2 



3D model builder application 
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Silhouette Processing Module 



106 



3E>Construction Module 



°5 -A CallUW fWok 

DO 



Triangulation Module 



llHr 



X 



103 



Silhouette Images 



.10*- 



Silhouette Mask Images 



Silhouette Contours 



707i 



Silhouette Contour Polygons 



Polygonal Mesh 
Model 




V 



Triangulated Mesh 
Model 



Texture Map Module 


I 


Texture Images 


I 



Fig. 10 
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15+ 



Silhouette Processing Module 

i 



Background Mask Procedure 

i 



Initial Silhouette Mask Procedure 



J" 



Coefficient Determination Procedure 

i — 



Background Subtraction Module 

i 



^ClusterizationSmall Cluster Removal Module ^ 



X 



Clusterization 



Remove Small 
Clusters 



*IW| 



T 



Polygon Shape Module 



Fig. 11 
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clusterization/small cluster removal module V- 

yi 



21^ 



} for each silhouette mask image 

1 1 r ..a?3 



read the next silhouette mask image 
Goad it into bitmap array) 
(identify offset) 



r ^ 

J data array j 



allocate array to hold point lists for 
silhouette contours 



2*3 



4 silhouette point list array \ 



while there are more silhouette contours to find 
e.g. while more_silhouettes = true 

i 



2116 



call the clusterization module 
e.g. returns list of silhouette contours 



aid loop e.g. 
more_silhouette=false 




clusterization sub-module 1 



for each new silhouette contour on list \ ~\, Q ^ 



flip bits within 
contour region and count the bks^ 

r 




3^5 lc 



small cluster removal 
sub-module 



add new silhouette contour * 
i to silhouette point list array a^, X y 



164* 




reset silhouette contour point ordering variable ^ S^~^)cO 



| store silhouette^ponit Ust array \ \^ p 




loop 



Fig. 19a 



— Clusterization Sub-Module (starting point, ordering direction) — — _ _ 



allocate data structure to 
hold silhouette contour lists found in this 
pass of the bitmap array 

initialize it to empty 
(e.g. new silhouette list) 

i 



allocate bitmap to perform search 
operation at the current level of searching H bitmap array [] 



silhouette list | 



do while more bits to check in bitmap array[] 3 ^ 



get color assignment of bit to check 
(get search direction) 




call procedure to determine silhouette contour 
List = traceSilhouette( current point) 



reorder point list (if needed) and 
add list to data structure 
(e.g. new silhouette list) 



Alter bitmap to mark as background" 
all bits within the boundary of the silhouette contour 




A/ 



return new silhouette list 



Fig. 19b 
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1 Trace Silhouette Procedure (first point, direction) j L . _ 



allocate data object to hold 
point list for silhouette contour 

intialize current point variable 
(e.g. current point = first point) 

allocate next point variable 



point list 



T 



loop to trace silhouette contour 
e.g. while (next point != first point) 



2<\\t 



call get next point function to find next point \ (j 



check if loop self-intersects 
if so do additional processing 

i 



put bitmap location of next point 

onto list of points in 
silhouette data object 



prepare for next iteration of loop 
e.g. current point = next point 




return data object to hold point list 
for silhouette contour 
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3D Construction Module 



Calibration Module 



10S 



Initial 3D Object Building Module 



3D Refining Module 




j 10* 

N 606 



Initial (rough) 
3D Model 








List of Vertices 



List of Polygons 



6/5 

TWO 



Fig. 23 



40^ 



Q\0 



] Initial 3D object building module 

Max Length ( 



Determine the maximum length 
for the object along the Z axis 



Select a silhouette contour polygon 
as the first polygon to process 



64 a 



Create a set of beginning and ending points 
(and far and near) polygons 



6<H 



Order the vertices of each face following ^ ^ *J Q 



an, e.g. counterclockwise ordering ^ 
and build face object 

l — 



Interconnect the far and near faces 
with additional faces 
(this creates a solid 3D object) 



Fig. 24 



r 



3D Retining Module 

i 



Loop to process each of the remaining silhouette contour polygons 
that are in each of the remaining silhouette images 

I 



A* 



obtain a reference to the next silhouette image 
and its angle of rotation 

r 



•73<? b 



project the vertices ot the (rough) 3D model 606 
onto the plane of the silhouette image 
(the plane of the CCD chip) 
and store all of those 2D coordinates in an array 

■ — 



•v73<?c 



obtain list of all of the silhouette contour polygons 
associated with that image 



Loop to process each of the faces of the current (rough) 3D model 606 



I 



obtain one of the faces of the ^ 
current (rough) 3D model ^ *1 L 



I 



T 



Prepare KD tree to analyze the projection of this face onto the 
plane which contains all of the silhouette contour polygons that 
are associated with this image 

i — 



Process the points of the current face 




7a V 



loop 



Procedure to Path Holes in Model 
Knifing Procedure 




loop 



Fig. 29a 




Fig. 29b 



j± 



Locate a starting point on the projected face 
(A point that is "OUTSIDE" of the silhouette contours) 
(IF There are no "OUTSIDE" points then terminate processing) 



mark point on the face as 'Visited' 
I 



Loop to tour the current vertices of the face 
} do until all of the face vertices have been 'Visited" 



Visited List I 

T 

7^3 c 



£ I get next point along the face ~J 3^> 




Create a new revised 
face list and tour the points 
See Fig. 29.d 

r 



Mark point as being visited | 



^ add new face to (rough) 3D model 1^ 1^^ 4 



locate next "OUTSIDE" point of face 
that has not yet been "visited" 
(If no more such points exist then 
terminate processing) 




loop 



753 it 



I 



Fig. 29c 



1. 



Locate the point of intersection along edge U> ~7S^ 





determine 3D coordinate for the new point 
add it to the list of vertices of the (rough) 3D model 



Add reference to new point onto 
the revised vertex list for the new face 



Set the Touring direction to 'TACE' 



~iz g ^ Sftt the Tnnrin g start f ° the rurrent p "^* 



get next point following the Touring Direction 



I 



loop to process the points until the next pont = starting point 

■ — c 



if the tour direction is 'Tace" 
then tour the face 
SeeFjg 29e 



if the tour direction is Silhouette Contour 

then tour the silhouette contour 
See Kg. 29f 
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Fig. 29d 



(when tEe system is touring the 
vertices and edges of the c TACE r 



Tfcurrent edge (edge that ends with next point) 
contains a new point of intersection. 



7TM 



locate the point of 
intersection along the edge 



determine a 3D coordinate 
for the new point (if it is a 
newly computed point then 
add it to the list of vertices) 



Add a reference to the new point 
onto the revised vertex list for the 
new face 



J" 



Add a reference to the new 
point onto the revised vertex 
list for the new face 



Add a reference to the new 
point onto the knifing list 
associated with the current 
edge of the silhouette 
contour polygon being 
intersected 



737; 



I 



Set the Touring Direction to 
be the Silhouette Contour 
that was just intersected 



Get Next Point By Face 
(Following Face Vertex List) 



T 



Get Next Point by Silhouette 
Contour (Following vertex 
list of Silhouette Contour) 



J (return to loop in step 7J5h)| 



~~\ — 
735 % 



Fig. 29e 
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(-7 35i?J 



T3 




L 



" (when thTsystem is touring the "~T 
vertices and e dges of a "SILHOUETTE CONTOUR POLYGON") | 



: current edge (edge that ends with next point) 
contains a new point of intersection^ 



determine a 3D coordinate for the 
new point (if it is a newly computed 
point then add it to the list of 
vertices) 



Add a reference to the new point 
onto the revised vertex list for the 
new face 



Add a reference to the new point 
onto the knifing list associated with 
the current edge of the silhouette 
contour polygon being traced 



XL 



-73*7 £ 



Get Next Point By Silhouette 
Contour Polygon 

(Following vertex List for Polygon) 



Cyesp 



locate the point of 
intersection along the edge 



1 



determine a 3D coordinate 
for the new point (if it is a 
newly computed point then 
add it to the list of vertices) 



n 
i 
i 



> 



Add a reference to the new 
point onto the revised vertex 
list for the new face 



Add a reference to the new 
point onto the knifing list 
associated with the current 
edge of the silhouette 
contour polygon being traced 



Set the Touring Direction to 
be the FACE 




Get Next Point by FACE 
(Following vertex list of the ^*L> 73*? 
FACE) | 'r< 



I 



(return to loop in step 73 5h) 



Fig. 29f 
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Fig. 30b 



—ft. 

Loop to process all of the knifing lists f y, 7^J^ 



J get a knifing list ^J]^ ^ L, 



sort the point pairs on the knifing list by 
the Z-value of the first point 



loop to visit each of the point pairs on the list 
do while there are more unvisited point pairs 



get a point pair that has not yet been visited 



determine if the second point of the 
current point pair overlaps with the 
first point of another point pair 




J mark the overlapping point pair as visited pv. lA^U 

r 



i 



combine the point-pair that overlaps 
with the current point-pair to make 
a larger point-set 



loop until no second/first point overlap exists 
J — land if current first point does not equal the current last point 




I create new faces from the organized list 14*3 




loop H-7^<7 



Fig. 31 
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747a 







.A:3J),80,50_; 


1 f 

e2 ! 


B:20,65,40 


e3 [ 


C: 10,50,30 


e4 ! 


D: 15,42,32 


e5 ] 


E:20,20,43 




F:25,1050 ' 



747r 



747g 



1 





Edge 6 


G:60, 15,80 


e7 1 


H:70,30,92 


f 

e8 j 


1:70,60,90 


e9 { 


J:60,80,75 


^ J 


K:50,85,70 



— c 



747s 



7471 



Edge 10 



7 



747n 



L:80,55,100 



M:82,25,110 



X 



1 



Edge 11 
N:90,26,115 



0:95,40,120 



R 8 . 3G 



Add additional edges to 
break each polygonal face that 
is not a triangle into a triangle 



Apply other processing 
I (e.g. adaptive subdivision of triangles) 





p to process each face of the 3D model 
=Zt= 



Get face 

i 



Get starting point 



Loop to process the current face 
(Stop processing when the face only 
Has 3 vertices) 



] Get the second and third points | ^ Cf^f 



Attempt to draw an edge between 
The starting point and the third point 




Load the starting point 
With the values of the 
Second point 



I 




creates a new object for 
This three point face 



adjust object relationships 



y 



I? 

I 5 * 



Loop to process each face 



Get a reference to the next face 



J set a "largest map image" pointer to nulT "Knot 



set a "largest pixel area'* variable to 0 
loop to process each texture map image 

1108 

^et a r eference to a next image ("the current imaged 1 1 1 6 

project a view of the current face on to a~ ' i * v 
2D projection the same plane as the texture map view Aj I 
determine the orientation of the face vis a vis 
the texture map image 





| compute the area (e.g. in pixels )) 
of the space of the face on the^U \ 
texture map plane. 




largest area = area computed aoove 



1112 



^fiapimage = current the irtiage } ) IT*— 




}IZ4 



/bad face data object with" reference to the "largest image/ 

r~ u — ) zzzrL 

load the face data object with x,y coordinate locations for f}Z f 



the texture map. 




loop 



'St 



select a texture map image 
(an additional texture map) 



:>nal te: 



i 



^project a view of tne texture map on ihescfeeTT"^ 

project an image of the 3D objecf also on the screen 
where the 3D object ir rotated to provide a view form 

the same view point as the camera when it took 
that textuj-e map image 



Set up for user events 
build coefficient list/matrix 



on mouse click locate the face trom the model 
that corresponds to the user input on a list 



c 



164 -A. 



i 




on doneButton 



Loop to proceeds each face on the 
'list 

J 



/ Place a reference to the 



additional texture map in the object's 
face 



[Calculate the x ? y coordinates for the 
lexture map area that will be mapped 
Jto the 3D coordinates of the face. 



.IIP- 



Place a reference to the xy 
coordinate for the texture map for 
^ar h pffin t in the face 



Clear face list J 




_ — 3D Model Builder Application 



\ Silhouette Processing Module ^ ' \ silhouette images 



406 



3D construction module 
rLaiibrationJ 



Triangulation module 

— z 



u>\o 



Texture Map module 



- X 



silhouette mask QQ r 
* image objects O Q j^ 7 / 




1 l&M- 

I 

i r ~ "* 

I boo 



y Spatial 

mesh nodegj, 
exture images 

dpQQQi 
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1^ silhouette processing module j ^_ ^ 



background mask procedure 



initial silhouette processing module 



X 



coefficient determination module 



t5< 



background subtraction module 



^145? 



^1440 



small cluster removal modu le ^[ £> ^ 

VU£2 1 Rem ° ve 0 
J l^mallClustersi 



Clusterization 



/ C 



X 



polygon shape building module 



V 



^ A 3D coordinate building module^ ^ Q 

\ silhouette mask writing module \^ 
— ■ ^1672 



V 4 




I"744 



T 



i 
i 



\ — I 3D construction module | ^ &0^> 

( ^initial (rough) 

[3D model 



initial 3D object building module 



} 



l?o4 



Max 



( | ) jhruct. 



For Face Info 



Ust of Vertices 




refining module 



Overlay. 3ifWtfe J v lOO 



1 modll 



The mesh triangulation module 



1 



The texture map module 



t *\<A 30 chjxci BuMnj MtoMk 



MO 



Detemunethe maximum length 
for the object alongtheZ axis 



"Select a polygonal image object \ 
As the first silhouette image to process^ 



Create a set of beginning and ending 
Points (and far and close) polygons 



I90H- 



l«lilfc 



Cirder the vertices of each face following an 
/ E.g. clockwise ordering. AM &0'U OfcTfcCfc 



if*- 



Interconnect the far and near faces 

with additional faces (this creates 

J A solid 3D object). 
^ 



J 




4 




-T 



refining module — — 



Loop to process each remaining sil houette image 
* 

Get reference to the silhouette image object ( 

j 1 



Create a 2D projection of the 3D" model 
And project the silhouette polygon on to this plane 



Make a list of faces of all of the faces from 
The model's 2D projection that intersect with 
The bounds of tfre silhouette polygon 



For each interconnected face 
Generate a new set of coordinates on the 
X,Y plane to bound the area of overlap 




For the newly revised faces, 
Generate any new 3D X,Y,Z, coordinates 
To corre spond to the new points 

- — 



Neighbor adjustment procedure 



I 



Add additional feces 



ao/3 



i 



• 



20iD , 




Loop to process each face references 
On the * f overlap"*list. 





902Z-' 



Begin with a point of the silhouette image 
That lies within the bounds of the current face 



Add this data point to the revised list 
Of points for the face 



2023 - 



20a 



Get the next point of the polygon silhouette being processed 
And begin a tour of its points moving in the direction of the view 
flfjhgjjacejn^uestio^ 



Determine wnether there ts an intersection 
Between the segment defined by the current point 
And the next point and any segment of the object 
That is not being toured (i.e. either the silhouette polygon 
Or the projected 2D image 



X 




rJ6 



Add "next point" to the 
faces list of vertices \ Q£ €^ ^ 



Obtain the intersection point 



set the current point to be , 
equal to the next point yy ^ |00 



get the next point from the 
object that is currently being toured 



jdjl- 



su06 
'^108 



Compute a 3D X.Y.Z, coordinate 
For that point of intersection 



3= 



Add this new point to the list of 
vertices for the face 




?>et tne tour now 16 be a tour ot the 

"Other object" if you were touring 
The polygon silhouette now tour 
•flu. f>rp)gcfr*rt 



Set the end point of the segment intersected to 
be the new next point 

— - — ~— — ~—c 



Loop through each face referenced on the overlap list 

I 



get a reference to the next face ^ 1 



s Rni +hU &ce the list of the faces "old" 
neighbors. (The neighbors the face had 
before it was adjusted by silhouette overlap) 



fertf> 



Loop for each neighbor fa ce ref erence" 

— r 



3 



"determine ft the neighbor is on' 
The list of revised laces - 







Do nothing 
go to next neighbor 
* . i 


> 






Lai 66 a ,55 



KJo 



9\$ 



GeTtlie vevised set of vertices 
For this neighbor 



I . , Find the common edge that exists 
A I kjO^ Between the two faces 



TfcfCFa reference to the 
Revised face in the corresponding 
Slot in the current face's neighbor list 




Add a refernce to this face on the 
Incomplete list 



Ui5 + 



Begin loop to process each facets has 
Been referenced on the|ncornplete list 



10 



[ v Get a reference to a face 



Loop to go the face's neignToHisUin? 
pro cess those slots that are null 



I jet a i eierence to a nei 





| Go to toe 2D projection and determine 
The origin of the face (i.e. whether it is 
Viewed internally or externally) 



3L 



[Get the 2D coordinates of the points That 
make up the edge segment that 
corresponds to the empty edge 
^_ (e g points A and B) 



I 



Using one of those points (which should be a 
'•drilled point") * g ^© \ r\ A 



aaoo 

^3.204 



3.20$ 



0.9,01 



Locate mat point in an ordered list of "drilled points' 



X 



Get the next point from the ordered list that 
corresponds to this point. Le A' 



For tbat next point, find a face that contains both A° 
and B' from 4-U. K/l *^ >Nt» *p\&Jpz. -fwCi/L- 



-onstructa new_fage object fertile found face [[ ^V I 0 



Order the new points offfie face to mamtaiflT' 
clockwise ordering the face would be viewed from its 
external side. 



Load the vertex and face data into the data object for 
the new face 



Update neighbor relationships for the new face 
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